Feature-Based Synthesis: Mapping Acoustic and Perceptual Features onto Synthesis Parameters
نویسندگان
چکیده
Substantial progress has been made recently in finding acoustic features that describe perceptually relevant aspects of sound. This paper presents a general framework for synthesizing audio manifesting arbitrary sets of quantifiable acoustic features of the sort used in music information retrieval and other sound analysis applications. The methods described have broad applications to the synthesis of novel musical timbres, processing by analysisresynthesis, efficient audio coding, generation of psychoacoustic stimuli, and music information retrieval research.
منابع مشابه
Feature-Based Synthesis for Sonification and Psychoacoustic Research
We present a general framework for synthesizing audio manifesting arbitrary sets of perceptually motivated, quantifiable acoustic features. Much work has been done recently on finding acoustic features that describe perceptually relevant aspects of sound. The ability to synthesize sounds defined by arbitrary feature values would allow perception researchers to more directly generate stimuli “to...
متن کاملPerceptual Synthesis Engine: An Audio-Driven Timbre Generator
A real-time synthesis engine which models and predicts the timbre of acoustic instruments based on perceptual features extracted from an audio stream is presented. The thesis describes the modeling sequence including the analysis of natural sounds, the inference step that finds the mapping between control and output parameters, the timbre prediction step, and the sound synthesis. The system ena...
متن کاملAn Audio-Driven Perceptually Meaningful Timbre Synthesizer
A real-time synthesis engine that models and predicts the timbre of acoustic instruments based on perceptual features is presented. The timbre characteristics and the mapping between control and timbre parameters are inferred from recorded musical data. In the synthesis step, timbre data is predicted based on new control data enabling applications such as synthesis and cross-synthesis of acoust...
متن کاملAnalysis and Synthesis of Facial Expressions by Feature-Points Tracking and Deformable Model
Face expression recognition is useful for designing new interactive devices offering the possibility of new ways for human to interact with computer systems. In this paper we develop a facial expressions analysis and synthesis system. The analysis part of the system is based on the facial features extracted from facial feature points (FFP) in frontal image sequences. Selected facial feature poi...
متن کاملThe feature extraction based hypersampler in Il grifo nelle perle nere: a bridge between player and instrument paradigm
This paper concerns the hypersampler implemented for my piece Il grifo nelle perle nere for piano and hypersampler, composed in 2008 and premiered during the 54 Venice Biennale’s International Festival of Contemporary Music, in the framework of XVII CIM – Colloquium on Music Informatics. The hypersampler involves a real-time synthesis engine based on processes of feature extraction as an altern...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006